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Abstract 


We  give  an  algorithm  vtdiich  merges  sorted  lists  represented  as 


balanced  binary  trees.  If  the  lists  have  lengths  m and  n (m  < n) 


which  is  the 


then  the  merging  procedure  runs  in  0 
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Introduction. 


Suppose  we  are  given  two  linear  lists  A and  P;  , each  ol'  -.diosi-- 
elements  contains  a key  from  a linearly-ordcsed  set.  such  that  '-ach  11  s', 
is  arranged  in  ascending  order  according  to  key  value.  Tlie  i roblem 
is  to  merge  A and  B , i.e.,  to  combine  the  two  lists  into  a single 
lineax  list  whose  elements  are  in  sorted  order. 

This  problem  can  be  studied  on  different  levels.  One  ai  t roach  is 
to  ask  how  many  comj>arisons  between  keys  in  the  two  lists  are  sufficient 
to  determine  the  ordering  in  the  combined  list.  This  is  an  attractive 
problem  because  it  is  relatively  easy  t.o  prove  lower  bounds  on  the  numb'.-r 
of  comparisons  as  a function  of  the  list  sizes,  using  an  "information- 
theoretic"  argument.  If  the  lists  A and  B have  m and  ri  elements, 
respectively,  then  there  ai’c  ^ ^ possible  ( lacements  id’  i he 

elements  of  B in  the  combined  list;  it  follows  that 
comparisons  are  necessary  to  distinguish  these  possible  orderings. 

If  we  take  m < n then  j”lg^^^'^^l  = 0^m  log  ^ ^ The  best 

merging  procedure  piresently  known  within  this  framework  is  the 
"binary  merging"  algorithm  of  Hwang  and  Lin  [11,5],  which  requires  fewer 
than  + min(m, n)  comiarisons  to  combine  sets  of  size  m 

and  n . 

A different  apqxoach  is  to  study  the  actual  running  time  of  merging 
algorithms  on  real  computers  or  on  more  abstrict  models  such  as 
pointer  machines  f9].  If  we  assume  that  comj'arisons  are  tlie 
only  way  oJ’  gaining  Information  about  key  values  1 lien  the  i.^in  1 >c  ^ ^ 

That  is,  the  left  hand  side  has  order  exactly  m log  ^ ; see  [ (' ] for 
a r renise  del'initiori  of  the  0 .-uid  Q notations. 


lower  bound,  r.till  applies  to  the  running  time  of  merging  algorithms, 
but  it  is  not  clear  how  to  achieve  this  bound  using  the  Hwang  - Lin 
procedure.  The  problem  lies  in  implementing  this  algorithm 
to  run  in  time  proportional  to  the  number  of  comparisons  it  uses. 

In  this  paper  we  give  a merging  procedure  which  runs  in  0 
time  on  a real  computer  or  a pointer  machine.  The  algorithm  uses  balanced 
binary  (AVL)  trees  [5]  to  represent  the  linear  lists;  2-3  trees  [1]  could 
also  be  used. 

In  Section  1 we  present  the  binary  merging  procedure  of  Hwang  and 
Lin,  and  note  wliy  it  seems  difficult  to  give  an  efficient  implementation 
of  this  algorithm.  We  develop  a merging  procedure  for  balanced  trees 
in  Section  2,  and  in  Section  3 we  prove  that  the  procedure  nms  in 
0 l^m  log  ^ ^ time.  Section  ^ gives  the  results  of  exj:ieriments  comparing 
our  algorithm  Tidth  three  straightforward  merging  methods.  A high-level 
language  im.plementation  of  the  fast  merging  algorithm  is  contained  in  the 
Appendix. 


(m  log  ^ ) 


1. 


of  respective  lengths  m and  n with  m < n , such  that 


a,  < ' , . . < a , and. 

12  m ' 


bi  < hg  < • • • *^n 


The  merging  method  is  most  easily  described  recursively.  When  m = 0 
(i.e.,  the  shorter  list  is  empty)  there  is  no  merging  to  be  done  and 
the  procedure  terminates.  Otherwise  we  attempt  to  insert  , the 
smallest  element  in  the  shorter  list  A , into  its  proper  position  in 
the  longer  list  B . To  do  this,  let  t = Llg(n/m)j  and  compare 
a,  : b ( is  the  largest  power  of  two  not  exceeding  n/m  ') . See 
Figxire  1. 


[Figiore  1] 


If  a b , , then  a.,  belongs  somewhere  to  the  left  of  b 

in  Figure  1.  By  using  binary  search  the  proper  location  of  among 

b-,,b„,  ...,b  can  be  found  with  exactly  t more  comparisons.  The 

2-1 

result  of  this  search  is  a position  k such  that  ^ ’ 

this  information  allows  us  to  reduce  the  problem  to  the  situation 
illustrated  in  Figure  2(a).  To  complete  the  merge  it  is  sufficient 
to  perform  binary  merging  on  the  lists  A'  and  B'  . 

[ Figure  2 ) 


If,  on  Uie  other  haiid,  a,  •-  b , , then  'i.  belongs  somewhere  to 

X X 

the  right  of  b ^ in  Figur"  1,  :aid  the  jiroblein  immediately  reduces  to 

p ■■ 

the-  situ-ation  lilustratt,-d  in  Figure*  2(b).  W-:  can  finish  the  m(*rge  by 


applying  the  binary  merging  procedure  to  the  lists  A'  and  B'  . Note 


that  A'  may  be  longer  than  B'  , so  that  in  the  recursive  calls  to  the 
binary  merging  procedure  the  roles  of  A and  B may  become  reversed; 
this  may  also  happen  in  the  first  reduction  above. 

This  algorithm  uses  comparisons  very  efficiently,  as  evidenced  by 


the  small  gap  between  the  upper  bound  of 


r K 


min  (m,  n ) 


comparisons  required  for  binary  merging  [hj  and  the  lower  bound  of 


comparisons  for  any  merging  method  based  on  comparisons. 


But  representing  the  lists  A and  B as  arrays,  which  is  the  obvious 
way  of  maJcing  the  individual  comparisons  take  constant  time,  forces 
insertions  to  be  expensive;  they  involve  moving  items  over  to  make 
room  for  the  inserted  items.  Hwang  and  Lin  [1]  were  concerned  with  an 
application  in  which  A and  B are  read  from  tapes  and  the  merged 
res\ilt  is  written  onto  a tape;  in  this  situation  the  merge  requires 
linear  time  (since  the  entire  result  must  be  written),  and  binary 
merging  can  only  improve  on  the  traditional  tape  merging  algorithm  by 
a constant  factor.  We  would  like  to  be  able  to  merge  list  structures 
A and  B and  produce  a result  list  of  the  same  ty[)e  in  0^  m log  ^ ^ 
total  operations. 
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Balanced  Tree  Merging. 

Ba-i-U'!'''!  binary  trees  [2,5]  are  good  data  structures  for  representing 
linear  lists  when  bot’ri  sea-'ches  airi  insertions  must  be  performed. 

A binary  tree  is  called  balanced  if  the  height  of  the  left  subtree  * 

of  every  node  never  differs  by  no  more  than  +1  from  the  height  )f  its  ■ 

right  subtree.  (The  height  of  a tree  is  the  length  of  the  longest  path  1 

from  the  rjot  ti  an  e-cternal  node.)  When  representing  a list  by  a 

balanced  binary  tree,  the  i-th  element  of  a list  becomes  the  i-th  node  , 

visited  during  a syf^metric  order  tra'/'c of  fne  Vjalanced  tree;  if  the  j 

list  is  sorted  Figure  3>  then  its  Keys  appear  in  increasing  order  , 

i 

during  such  oal.  When  a sorted  list  of  length  n is  aaintaiaed  ■ 

in  this  way,  we  can  locate  the  proper  position  in  the  list  for  a new  ■ 

elenent  in  0(log  n)  steps,  using  ordinary  binary  tree  search.  To 

insert  this  element  into  the  list  maj"  ''equire  O(log  n)  additional 

steps  for  rebalancing  the  tree.  We  shall  assume  reader  familiarity 

with  Algorithm  6.2.3A,  the  balanced  tree  search  and  inr. evti  oti  algorithm 

of  [5]. 

[ Figure  3 ) 

An  obvious  method  of  merging  two  sorted  lists  repreS'Unted  as 
balanced  trees  is  to  insert  the  elements  of  the  smaller  list  into  the 
larger  list  one  by  one.  The  result  of  merging  the  two  lists  of  Figure  3 
using  this  scheme  is  shown  in  Figure  U,  If  the  smaller  list  contains 
m '.'lements  and  the  larger  has  n elements  then  this  algorithm  performs 
m insertions  of  O(log  n)  stejis  each,  for  a total  cost  of  l('n  log  u)  . 

But  wc  •i’-e  seeking  a method  which  runs  in  O^m  log  ^ ^ time. 

[ Figure  !t  [ 


f) 


To  see  why  there  is  some  hope  of  improving  this  simple  merging 
procedure  we  refer  again  to  Figure  k,  which  shows  the  search  paths  traced 
out  during  the  insertions.  An  interesting  property  of  these  paths  is 
that  they  share  many  nodes  near  the  top  of  the  tree.  The  root  is  visited 
on  all  of  the  searches,  and  its  two  offspring  are  each  visited  on  roughly 
half  of  the  searches;  we  must  descend  at  least  Ig  m levels  into  the  tree 
before  all  of  the  search  paths  become  disjoint.  It  appears  that  our 
simple  merging  strategy  spends  Ig  m steps  on  each  insertion,  or 
0(m  Ig  m)  steps  total,  examining  nodes  in  the  top  Ig  m levels  of 
the  tree.  Since  there  are  only  0(ra)  nodes  contained  in  these  levels, 
eliminating  duplicate  visits  should  make  our  algorithm  run  in 
0(m  log  n - m log  m + m)  = O^m  log  ^ ^ time. 

We  can  eliminate  extra  visits  since  the  items  being  inserted  are 
themselves  already  sorted;  by  simply  inserting  these  items  in  order  we 
can  ensure  that  once  an  item  has  been  inserted,  no  smaller  item  will  be 

inserted  later.  Figure  ^ich  shows  the  situation  after  a node  x has 

been  inserted,  indicates  how  this  can  help.  If  node  y > x is  now 
inserted,  then  y must  lie  somewhere  to  the  right  of  x in  the  tree. 

To  determine  where  y belongs  it  is  sufficient  to  climb  back  up  the 
search  path,  comparing  y to  nodes  on  the  path  which  are  greater  than 
X \intil  a node  is  fo\md  which  is  greater  than  y ; then  y can  be 
inserted  into  the  right  subtree  of  the  previous  node  examined  during 
the  climb.  (For  this  purpose  it  is  convenient  to  think  oV  the  root  as 
Viaving  a parent  with  key  +®  . ) In  Figure  5)  if  Y > ' y < f' 

then  y should  be  inserted  into  the  right  subtree  of  node  7 ; if  y < ' 

then  y becomes  the  right  offspring  of  x . 

[Figure  5] 
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An  algorithm  based  on  this  idea  is  easy  to  state  informally.  As  in 
our  description  of  binary  merging,  let  A and  B be  sorted  lists  of 
length  m and  n , with  m < n , and  assume  that  these  lists  are 
represented  as  balanced  trees.  In  the  first  step  of  our  algorithm  we 
insert  a^^  , the  smallest  element  of  A , into  the  tree  B . At  the 
start  of  a general  step,  elements  a-| , a^,  . . . , a^^  have  been  inserted 
into  B , and  we  have  a record  of  the  search  path  to  a^  (Figure  6(a)). 

This  path  acts  as  a "finger"  into  the  tree  B during  the  algorithm, 

moving  from  left  to  right  through  B as  elements  from  A are  inserted; 
the  finger  is  useful  because  only  nodes  to  the  ri^t  of  it  can  be  visited 
during  later  insertions. 

[Figure  6] 

The  general  step  has  two  parts.  First  the  finger  is  retracted 
toward  the  root,  just  far  enough  so  that  the  position  of  element 
lies  within  the  subtree  rooted  at  the  end  of  the  finger  (Figure  6(b)). 
Then  a,  is  inserted  into  this  subtree,  and  the  finger  is  extended  to 

follow  the  jath  of  this  insertion  (Figure  6(c)).  After  m-1  executions 

of  this  general  step  the  merge  is  complete. 

This  scheme  is  complicated  by  the  fact  that  rebalancing  may  be 
necessary  during  insertions  into  a balanced  tree.  When  rebalancing 
takes  place,  it  may  remove  a node  from  the  finger  path  traced 
out  by  the  search.  It  is  possible  to  update  the  recorded  j ath  to  be 
consistent  with  this  rearrangement,  but  it  seems  easier  jusc  to  "forget" 
about  the  pa^t  of  the  path  which  is  corrupted,  i.e.,  to  retract  the 
finger  path  back  to  the  point  of  rebalancing.  The  algorithiri  then  takes 
the  form  shown  in  Figure  7-  At  the  start  of  a general  ste]i  we  now  have 
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recorded  only  part  of  the  search  path  to  the  last  element  inserted.  The 
general  step  proceeds  as  before,  but  after  the  insertion  a part  of  the 
search  path  may  be  discarded.  There  is  no  need  to  treat  the  first 
insertion  specially  in  this  algorithm;  we  simply  initialize  the  finger 
path  to  be  the  root  of  B (which  is  certainly  on  the  path  to  the  first 
insertion),  and  execute  the  general  step  m times. 

[Figure  7] 

In  an  implementation  of  this  scheme  it  is  useful  to  maint  -.in  a 
record  of  those  nodes  on  the  finger  path  at  which  the  path  tui-ns  left 
(i.e.,  nodes  on  the  path  whose  left  offspring  is  also  on  the  path). 

It  is  easy  to  see  that  these  are  precisely  the  nodes  on  the  path 
(excluding  the  last  node)  which  are  larger  than  the  most  recently 
inserted  item;  according  to  Figure  5,  only  those  nodes  must  be  examined 
while  climbing  upward  in  the  tree  in  the  first  part  of  the  general  step. 
Bad  cases  may  occur  if  we  don't  record  these  nodes  and  must  examine 
small  nodes  on  the  finger  path,  as  illustrated  in  Figure  8.  If  a node 
y > X is  inserted  in  the  situation  shown,  the  entire  path  up  to  the 
root  must  be  climbed  to  see  if  y > a . If  it  turns  out  that  y < a , 
then  y becomes  the  right  offspring  of  x and  the  same  situation  can 
be  repeated. 

[Figure  8] 

Using  these  ideas  we  can  express  the  balanced  tree  merging  algorithm 
in  an  Algol-like  notation.  (The  control  constructs  used  in  this  notation 
are  adajted  from  Knuth  [('']•)  We  keei  pointers  to  nodes  on  the  finger 
jath  in  a stack  xa-th,  and  pointers  to  the  "large”  path  nodes  (in  the 
sense  of  the  previous  paragraph)  in  a successor  stack.  The  nodes  of 


the  balanced  tree  are  taken  to  have  fields  Key  , ILlnk  , rLink  , and  B 
(balance  factor),  as  in  Algorithm  f.2.5A  [5].  The  balance  factor  may 
tai'.e  on  the  values  leftTaller,  balanced,  and  rightTaller,  which  have 
obvious  interjretations;  the  rebalancing  step  depends  on  the  relation 
leftTaller  = -rightTaller  which  is  assumed  to  hold. 


begin  fpast  balanced  tree  merge] 


initialize  j ath  to  contain  the  root  of  the  larger  tree,  and 
height  to  be  the  height  ol'  the  larger  tree 
initialize  successor  to  be  empty 


for  each  node  in  the  smaller  tree; 


X ^ next  node  from  the  Gma21er  tree,  in  symmetric  order,  initialized 
so  that  lLink[x]  = rLink[ x]  = Nil  and  B[x]  = 0 


r climb  up] 

lo^  until  successor  is  empty  or  Key [ x ] < Key [top  of  successor] : 
I007  until  toj  of  I ath  = top  of  successor: 

remove  toj)  from  path 
rej^c^at 

remove  toj  from  successor 


rep-.-at 

p ^ top  of  1 ath 
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{;-erirch  down  and  niu'.ert] 

lOOH 

lfj^[.x]  Kw[p]  then 

ii’  lLink[j']  = Nil  l.hen  goto  leftrlil 

else  push  p onto  successor 
p •-  lLink[p]  endif 

else 

if  rLink | p ] = Nil  then  goto  rightNil 


else  p — rLink [ 7']  endif 


endif 

push  p onto  I'fith 
rcj^t 

tlien  leftNil  =>  ILink  1 nj 
I’i  ( 'ht Ni  1 ^ r Li  n k ( t 


endlooT 


{adjust  balance  t'acti  rsj 
iOoT 

j oi  -j  ath  i nto  s 

ijntjJL  ]M-")  / balmic«.‘d  .>r  j ath  Is  empty: 

B(g]  - KSl[-'<1  < i^lj]  then  leftTaller 

rightTaller ) 

il'  successor  is  not  em-fty  and  toi  of  path  = top  of  succ 
then  rer;.  Vo  toj  :'roii;  .uccessor  endif 

roT  eat 

a - Key [ x ] < Key [ s ] then  leftTaller  else  rightTaller) 


U 


[rebalance  the  subtree  rooted  at  s;  this  part  of  the  program  is 
essentially  a translation  of  steps  7-10  of  Algorithm  6.2.3A  [5]] 
if  B[s]  = balanced  then  [entire  tree  has  increased  in  height] 

B[s]  - a;  height  <-  height  + 1 

else  if  B[s]  = -a  then  [subtree  has  become  more  balanced] 

B[ s]  •-  balanced 

else  [rotation  is  necessary  to  restore  balance] 

r >-  (if  Key[x]  < Key  [ s ] then  lLink[  s]  rLink[  s] ) 

if  Bfr]  = a thra  [single  rotation] 

it'  a = rightTaller  then  rLink[ s ] - lLink[ r ] ; lLink[ r ] - ? 

else  ILinkfs]  - rLinkfr];  rLink[r]  - s endif 
B[s]  -Bfr]  balanced 


else  [double  rotation] 

if  a = rightTaller  then 

p - lLink[ r] ; lL:nk[r]  - rLinkjp] ; rLinkfp] 
rLinkf s ] — ILinkf ] ] ; ILinkf p ] - s 

else 

j - rl.j  nk [ r] ; rLinkfr]  - ITjlnkf  ] ] ; ILinkfp] 
ILinkf  s j - rLinkf p] ; rLinkf  p]  — s 

endi  f 

Bfs]  - (if  B[p]  = +a  then  -a  ei^se  balanced) 

Bfr]  - (if  Bfp]  = -a  ijicn  +a  £^c  oalanced) 

Bfj]  - balanced 

- ^ I 

endil' 


endi  f 

: ush  onto  tnth 


r-'  : '.'at 

[Th<;  root  of  i.he  result  tree  is  <>n  t.he  bottom  of  inth,  and  It.s  height  is  he i girt ] 
■ nd  frast  bal-ijiced  tre<j  merge] 


3 . Running  Time. 


In  order  to  analyze  the  running  time  of  the  balanced  tree  merging 
algorithm,  it  is  necessary  to  look  at  the  details  of  the  rebalancing 
procedure  (steps  6-10  of  Algorithm  6.2.3A  [5])-  For  the  purjiose  of 
this  discussion  we  shall  adopt  a concise  notation  for  balance  i'actors: 
the  balance  factor  of  any  node  is  either  0 (left  and  right  subtrees 
of  equal  height),  + (right  subtree  of  height  one  greater  than  left 
subtree),  or  - (right  subtree  of  height  one  less  than  left  subtree'', 

A node  with  balance  factor  0 is  called  balanced,  and  the  other  nodes 
are  unbalanced. 

When  a node  x is  inserted  in  place  of  an  external  node  in  a 
balanced  tree,  this  may  cause  ancestors  of  x in  the  tree  to  increase  in 
height.  To  rebalance  the  tree  we  examine  successive  ancestors  of  x , 
moving  up  toward  the  root.  During  this  climb  we  change  the  balance 
I'actor  of  each  balanced  node  to  + or  - as  apiropriate  vuitil  an 
unbalanced  node,  say  z , is  fo\ind.  (if  we  reach  the  root  without 
finding  an  unbalanced  node  then  the  entire  tree  has  increased  in  height 
and  the  insertion  is  complete, ) Insertion  of  x causes  node  z to 
become  either  balanced  or  doubly  heavy  on  one  side.  II'  z becones 
balanced  we  simply  change  its  balance  factor  to  0 ; otherwi se  we 
locally  modify  the  subtree  rooted  at  z to  restore  balmice  wliile 
leaving  its  height  the  same  as  it  was  before  node  x was  inserted,  Ihe 
two  local  transformations  shown  in  Figure  9 will  rebaliince  ilie  subtree 
in  all  cases.  oince  the  subtree  rooted  at  z does  not  etifuige  in  heighi, 
no  nodes  above  z need  be  examined  during  iiie  inseriion. 


[ Figure  o 1 

Cal]  a node  "liandled"  if  ii.  is  rnonijulaled  by  ihe  lialanced  tree 
merging  algorithm.  We  shall  obtain  an  0(m  log(n/m))  bound  on  Itie 
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iTuining  time  ol'  the  algorithm  by  showing  that 

|(i)  the  time  required  by  the  algorithm  is  proportional  to  the  number 
of  handled  nodes  (where  a node  is  coruated  only  once  even  if  it  is 
handled  many  times),  and 

(ii)  the  total  number  of  handled  nodes  is  0(m  log(n/m’)  ) . 

Wo  proceed  by  means  of  a sequence  of  lemmas. 

Lemma  1.  The  time  required  by  the  binary  tree  merging  algorithm  is 
bounded  by  a constant  times  m plus  a constant  times  the  number  of 
additions  to  and  deletions  from  the  jiath  and  successor  stacks. 

I'rool'.  An  inspection  of  the  program  shows  that  the  algoritlim  requires 
a bounded  ainount  of  time  per  insertion  jlus  a bounded  amount  of  time 
i er  addition  to  or  deletion  from  a stack,  Lj 

Lemma  2.  The  total  nimiber  of  additions  to  a stack  is  bounded  by 
the  total  number  of  deletions  plus  the  number  of  handled  nodes. 


(roof.  The  number  of  stack  additions  exceeds  the  number  of  deletions 
by  the  number  ot  elements  in  the  stack  when  the  algorithm  teniunates. 

But  each  node  in  the  stack  has  been  handled,  so  the  result  follows, 

(iTie  maximum  s.tack  depth  is  actually  O(log(n<-m))  , which  is  generally 
much  smaller  than  the  number  of  handled  nodes. ) □ 

Nodes  ai’e  deleted  from  stacks  at  two  jioints  in  the  progr;im;  while 
a'l. justing  balance  ''actors  during  rebalancing,  rjnd  wliile  climbing  up  the 
. ath  during  insertions.  We  now  analyze  each  case  in  turn. 

L'-nma  i.  iTie  number  of  deletions,  from  stacks  during  rebalancing  cannot 
‘•xe-'i.'d  a conslumt  times  tfio  number  of  fiondled  nocies. 
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Froof.  All  nodes  handled  during  a rebalancing  step  except  at  most  three 
have  their  balance  factor  changed  from  0 to  either  + or  - . Thus 
each  path  stack  deletion  excep.d  three  per  rebalancing  "uses  up"  a balanced 
node^  and  each  rebalancing  creates  at  most  three  balanced  nodes.  Since 
the  initial  pool  of  balanced  nodes  which  are  handled  cannot  exceed  the 
total  number  of  handled  nodes,  the  total  number  of  p)ath  stack  deletions 
during  rebalancing  is  no  more  than  the  number  of  handled  nodes  plus  six 
times  the  number  of  rebalancings.  The  number  of  successor  stack  deletions 
during  rebalancing  cannot  exceed  the  nimber  of  path  stack  deletions  during 
rebalancing.  The  lemma  follows.  ^ 

Lemma  1.  The  number  of  deletions  from  stacks  during  insertions  cannot 
exceed  a constant  times  the  number  of  handled  nodes. 

I roof.  FJach  node  y deleted  from  the  successor  stack  during  insertion 
has  a key  smaller  than  the  key  of  the  node  x currently  being  inserted; 
thus  y can  never  again  be  added  to  (or  deleted  from)  the  successor 
stack.  Hence  each  handled  node  can  be  deleted  from  the  successor  stack 
during  inseri.ion  at  most  once. 

bach  node  y deleted  from  the  p ath  stack  during  insertion  is 
either  (i)  deleted  from  the  successor  stack  during  the  same  insertion 
or  (ii ) has  the  property  that  y occurs  in  a subtree  with  root  s 
such  that  Key(y)  < Key(z')  < Key(x')  , where  x is  the  node  currently 
being  inserted.  (Here  z is  the  node  on  top-  of  successor  wiu'n  y is 
r* ‘moved  from  p ath . ) 

The  number  oJ'  nodes  y satisfpring  (i  i caruiot  exceed  the  number  of 
nod'.-s  deleted  from  the  successor  stack,  ajid  hence  the  number  of  liandled 
tiod“s.  Consider  a node  y satisl'ying  (ii  ) alter  it  lias  b(?en  deleted 


1‘.; 


from  the  path  stack.  Rebalancing  may  now  take  place  above  z , at  r.  , 
or  in  the  right  subtree  of  z , but  inspection  of  Figure  9 shows  that  in 
any  case  property  (ii)  is  preserved  for  y , A node  y which  satisfies 
(ii)  and  is  not  on  the  path  r can  never  again  be  added  to  (or 
deleted  from)  the  path  stack,  '■■nee  the  key  of  the  left  child  of  z will 
never  be  compared  against  the  key  of  a node  being  inserted,  'fhus.  the 
number  of  path  stack  deletions  satisfying  (ii)  is  at  most  one  per  handled 
node. 

In  summary,  at  most  three  stack  deletions  per  handled  node  can  occur' 
during  insertions.  □ 

Theorem  1.  The  total  time  required  by  the  balanced  tree  merging 
algorithm  is  bounded  by  a constant  times  the  number  of  handled  nodes. 

Proof.  Immediate  from  Lemmas  l-^r.  u 

The  bound  on  the  number  of  handled  nodes  is  proved  in  two  steps. 
First  we  show  that  when  the  algoritiim  terminates,  most  of  the  handled 
nodes  constitute  a subtree  of  the  balanced  tree  resulting  from  the  merge, 
and  this  subtree  has  at  most  m terminal  nodes  (nodes  halving  no  internal 
node  of  the  subtree  as  an  offspring).  Then  we  bound  the  number  of  nodes, 
that  any  such  a subtree  of  a balanced  tree  may  have. 

Lemma  9 . After  k insertion-rebalancing  stej's,  the  set  of  handled 
nodes  consists  of  no  more  than  k nodes  ] lus  a subtree  of  the  entire 
balance'd  tree  containing  no  more  tlian  k temunal  nodes,  and  containing 
•ill  ancestors  of  the  most  recently  inserted  vertex. 
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Proof.  We  prove  the  lemma  by  induction  on  k . The  lemma  is  certainly 
true  for  k = 0 . Suppose  the  lemma  is  true  for  k-1  . Let 
the  subset  of  handled  nodes  which  forms  a subtree  with  k-1  or  fewer 
terminal  nodes  containing  all  ancestors  of  the  node  inserted  at  the 
k-1  -st  step.  Let  ^ be  the  remaining  k-1  or  fewer  handled  nodes. 
Each  node  handled  d\iring  the  k-th  insertion  is  an  ancestor  of  either  the 
node  ^ inserted  at  the  k-1  -st  step  or  of  the  node  inserted 

at  the  k-th  step.  Let  be  formed  from  by  adding  all  ancestor^ 

of  Xj^  . Then  T^  forms  a subtree  with  k or  fewer  terminal  nodes. 

The  k-th  rebalancing  step  does  not  handle  any  new  nodes  but  may 
alter  the  shape  of  the  overall  tree  and  thus  may  rearrange  the  vertices 

in  T/  . However,  an  inspection  of  Figure  9 reveals  that,  after 

rebalancing,  the  nodes  in  T^  still  form  a subtree  having  the  same 
number  of  terminal  nodes  as  before,  except  for  possibly  one  additional 
"special"  terminal  node.  This  special  node  is  a child  of  a node  with 
two  offspring,  so  removing  it  from  T^  does  not  create  a new  terminal 
node.  In  Figure  9,  node  z becomes  special  if  T^  does  not  enter 
either  of  the  subtrees  a or  0 . If  z becomes  special  after 
rebalancing,  let  Tj^  = T^-{2]  and  U {z}  ; otherwise  let 

Tj^  = T^  and  p • Then  Tj^  and  satisfy  the  lemma  for  k . 

Lemma  6.  Let  T be  any  balanced  tree  of  k nodes.  Let  T'  be  any 
subtree  of  T with  at  most  t terminal  nodes.  Then  T'  contains 
0(f  log(k/£^)  nodes. 

Proof.  By  Theorem  6.2.5A  of  [51,  a balanced  tree  of  heiglil 
h = l.UUoU  lg(k/ £ ^ 2)  -0.528  must  contain  at  least  k'f  nodes.  If 

T has  height  less  than  h+2  , then  T'  can  be  partitioned  into  £ 

paths,  each  of  length  less  than  h+2  , and  the  lemma  is  true. 
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On  the  other  hand,  suppose  the  height  of  T is  no  less  than  h+2  . 


We  shall  conceptually  subdivide  T into  smaller  trees  as  follows: 
let  the  set  R consist  of  the  root  of  T , plus  all  other  nodes  in  T 

which  have  height  h+2  or  greater.  It  is  not  hard  to  see  that  R forms  ] 

a subtree  of  T , as  shown  in  Figure  10,  and  that  the  remaining  nodes  | 

of  T are  partitioned  into  a set  of  disjoint  subtrees  • 

[Figure  10] 

A balanced  binary  tree  has  the  j)roperty  that  if  v is  any  node, 
the  heights  of  the  two  children  of  v differ  by  at  most  one.  Thus  the 
difference  in  height  between  v and  either  of  its  two  children  is  at 
most  two.  It  follows  that  each  subtree  has  height  h or  h+1  , 

since  if  the  height  was  less  than  h then  the  pai'ent  (which  lies  in  R 'i 
would  have  height  less  than  h+2  . By  the  choice  of  h this  guarantees 
that  each  contains  at  least  k/f  nodes,  so  there  are  at  most  ( 

subtrees  . Each  of  these  subtrees  is  attached  to  an  external  node 
of  the  "root"  subtree  R , so  there  are  at  most  ?-l  nodes  in  R . 

With  T subdivided  in  this  way  it  is  easy  to  bound  the  number  of 
nodes  in  T'  . The  nodes  of  T'  which  do  not  lie  in  R can  be 
} iiTtitioned  into  f paths,  each  lying  completely  within  a subtree  . 

Since  each  such  path  has  length  not  exceeding  h^l  , the  totjil  number 
of  nodes  in  T'  cannot  exceed  f-l+  lg(k/f  + 2)  *-  = 

0(f  log(k/;))  • □ 

Theorem  2.  The  total  number  of  nodes  hfjndled  by  the  balcuiced  tree 
merging  algoriUim  is  0(m  log(n/m))  . 

! ro' ' The  total  number  of  nodes  in  the  tree  resulting  from  iiie  merge 

i.  in*n  . Thus  by  Lemmas  ')  and  ' the  totjtl  number  of  h;uidled  nodes  is  no  I 
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more  than  m+ 0(m  log((m+n)/m) ) = O(mlog(n/m)'  . □ 

Theorem  3.  The  balanced  tree  merging  algorithm  requires  0(m  log(n/m)) 
time  to  merge  lists  of  sizes  m and  n with  m < n , 

I, 

Proof.  Immediate  fron  Theorems  1 and  2.  □ Is 

i 

ii 

One  may  wonder  why  the  proof  of  Theorem  5 is  so  ccmplicated,  while 
the  informal  motivation  given  for  this  bovind  in  Section  2 was  so  simple.  . 

Perhaps  the  reason  is  that  each  insertion  changes  the  structure  of  the 
tree;  thus  it  seems  necessary  to  analyze  the  stack  operations  directly. 
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It . Imrlementati  on . 

It  is  possible  for  an  algorithm  to  be  very  fast  asymptotically,  but 
to  be  terribly  slow  when  applied  to  problems  of  a practical  size  for 
present-day  computers.  Therefore  it  is  worthwhile  for  us  to  compare 
our  balanced  tree  merging  algorithm  with  other  merging  procedures  to 
determine  when  the  new  method  is  actually  "fast".  In  the  discussion 
below  we  shall  refer  to  our  balanced  tree  merging  algorithm  as  Algorithm  F. 

One  straightforward  merging  procedure  for  linear  lists  represented 
as  balanced  trees  has  already  been  described  in  Section  2 : that  of 
inserting  the  elements  of  the  smaller  tree  one  by  one  into  the  larger 
tree.  We  shall  call  this  method  Algorithm  I.  Since  this  procedure 
requires  0(m  log  n)  time,  we  exj^ect  it  to  be  most  useful  ;vaen  m is 
very  small  compared  to  n . 

Another  simple  merging  procedure  for  balanced  trees  is  to  scaii 
entirely  through  both  trees  in  increasing  order  and  j.'erl'orm  a standard 
two-way  merge  of  the  lists.  This  method,  wliich  we  call  Algorithm  T, 
divides  nicely  into  three  stages  of  coroutines.  The  first  stage  routines 
dismantle  the  input  trees  and  send  their  nodes  in  increasing  order  to 
the  next  stage,  (identical  routines  are  also  needed  to  dismantle  the 
smaller  tree  in  Algoritlims  F and  I. ) The  second  stage  com3>cires  the 

smallest  elements  remaining  in  the  two  lists,  and  sends  the  smaller  of  i 

the  two  elements  to  the  third  stage.  The  final  routine  accej'ts  nodes  in  ^ 

increasing  order  and  creates  a balanced  tree  from  them.  Given  that  the 

total  number  of  nodes  is  known  in  advance,  a simple  way  to  construct  this 

tree  in  linear  time  is  to  divide  the  nodes  as  evenly  as  j'Ossible  between 

the  left  and  right  subtrees  of  the  root,  building  these  subti'ees 

recursively  by  the  same  method  If  they  are  nonemity.  A more  elaborate  i 

J 
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construction  vfliich  works  even  if  the  number  of  nodes  is  not  known  in 


advance  is  given  in  [5,  Exercise  6.2.3-21] . Algorithm  T requires 
O(m^-n)  time,  so  it  may  be  a good  method  when  m is  almost  as  large 
as  n . 

A final  method  vdiich  should  be  part  of  our  comparison  is  Algorithm  L, 
standard  two-way  merging  of  singly- linked  linear  lists.  The  running 
time  of  this  proced'ure  is  9(m+n)  , like  Algorithm  T,  but  we  expect 
Algorithm  L to  be  more  efficient  because  the  first  and  third  stages  of 
Algorithm  T become  much  simpler  >hen  singly-linked  lists  are  used  instead 
of  balanced  trees. 

For  the  purposes  of  comparison,  each  of  these  algorithms  was 
implemented  in  the  assembly  language  of  a hypothetical  multiregister 
computer  [6].  Each  instruction  executed  is  assumed  to  cost  one  unit 
of  time,  plus  another  unit  if  it  references  memory  for  data.  By  inspecting 
the  programs,  we  can  write  expressions  for  their  running  time  as  a function 
of  how  often  certain  statements  are  executed.  The  average  values  of 
these  execution  frequencies  are  then  determined  either  mathematically 
(in  the  case  of  Algorithms  T and  L)  or  experimentally  (in  the  case  of 
some  factors  in  Algorithms  F and  I).  The  experimental  averages  are 
determined  by  executing  hi^-level  language  versions  of  the  algorithms 
under  a system  vdiich  automatic  ally  records  how  often  each  statement  is 
executed  [8,  Appendix  F]. 

The  results  of  this  evaluation  are  summarized  in  Figure  11,  which 
gives  formulas  for  the  average  running  time  of  each  of  the  four  aJgoritiims. 
Figure  1?  comjiares  the  three  balanced  tree  merging  algorithms  by  showing 
the  values  of  the  list  sizes  m and  n for  which  each  of  the  three 


algorithms  is  faster  than  the  other  two.  It  turns  out  that  Algorithm  F 
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beats  Algorithm  I when  m > U.Oln'  , and  Algorithm  F is  faster  than 
Algorithm  T when  m < .355n  . Furthermore,  Algorithm  F is  never  more 
about  35^  slower  than  Algorithm  I,  or  5^^  slower  than  Algorithm  T.  Thus 
Algorithm  F seems  to  be  a practical  merging  procedure  for  balanced  trees. 

[Figures  11  and  12] 

In  some  situations  the  flexibility  of  balanced  trees  may  not  be 
needed,  and  the  simpler  singly-linked  list  representation  might  seem 
preferable.  Our  comparison  shows  that  from  the  standpoint  of  merging, 
balanced  trees  are  worthwhile  whenever  the  lists  being  merged  differ 
in  size  by  a factor  of  l6.5  or  more.  So  in  order  to  derive  a benefit 
from  the  simpler  representation  we  must  keep  the  merges  fairly  well 
balanced. 

It  now  seems  appropriate  to  make  some  general  remarks  about  Algorithm  F 
and  its  imjilementation.  Our  first  observation  is  that  the  general 
scheme  of  the  algorithm  and  its  running  time  proof  apply  directly  to 
2-3  trees  (or  general  B-trees).  For  example,  the  argument  of  Lemma  3 
concerning  the  number  of  balanced  nodes  handled  during  rebalancing 
translates  into  an  argiment  about  the  number  of  full  nodes  (nodes 
containing  two  keys)  handled  during  splitting  in  the  2-3  tree  case. 

The  algorithm  might  be  easier  to  state  in  an  abstract  way  in  terms 
of  2-3  trees,  rather  than  balanced  trees,  but  as  soon  as  a representation 
for  2-3  trees  is  specified  the  algorithm  becomes  just  as  comp3.ex.  One 
possible  advantage  if  2-3  trees  is  that  when  they  are  i-epresented  as 
binary  search  trees  [5  , P-  they  use  only  one  bit  per  node  as  a 

balance  factor. 


The  merging  algorithm  could  he  implemented  to  operate  on  triply-linked 
balanced  trees  [ 2 ],  which  contain  a pointer  in  each  node  to  its  parent. 

In  this  case  the  path  stack  would  be  unnecessary,  since  the  upward 
links  provide  the  information.  If  the  tree  were  also  threaded  in  an 
appropriate  way  then  the  successor  stack  could  be  eliminated. 

The  program  given  in  Section  2 uses  only  conventional  stack  operations 
on  the  path  and  successor  stacks;  hence  it  is  clear  that  this  program  can 
run  on  a j-ointer  machine  within  our  time  bound.  On  a conventional 
computer  we  would  implement  the  stacks  as  arrays,  with  an  integer  stack 
pointer.  Then  rather  than  keeping  pointers  to  nodes  as  entries  in  the 
succorsor  stack,  we  can  keep  pointers  to  the  path  stack  entries  for  these 
nodes.  This  allows  us  to  delete  all  path  entries  up  to  the  top  node  of 
successor  by  simply  assigning  the  top  element  of  successor  to  the  path 
stack  pointer,  which  makes  the  climbing-up  phase  of  each  insertion 
considerably  1 aster  and  hence  reduces  the  coefficient  of  m lg(n/m) 
in  the  ruuning  time.  The  implementation  given  in  the  Appendix  uses 
this  stack  technique,  and  also  retracts  the  stacks  during  rebalaiicing 
only  if  rebalancing  invalidates  some  of  the  path;  the  latter  change  in 
the  algorithm  has  little  effect  on  its  running  time  since  rebalancing 
seldom  occurs  high  in  the  tree. 

A further  improvement  in  the  algorithm  comes  from  considering  the 
relationship  between  our  method  and  the  Hwang  - Lin  binary  merging 
] rocedure  i resented  in  Section  2.  A principal  distinction  between  the 
■^wij  is  that  binary  merging  always  probes  near  to  wiiere  the  item  being 
inser*  ''!  is  expected  to  fall;  with  balaiiced  trees  we  climi)  up-  the  search 
path  luring  insertions  and  examine  nodes  which  are  very  tuilikely  to  be 
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than  ttie  item  boing  innertud.  Uning  an  arrn;;,'  i'tack  im]  lomentation 
wo  o;ui  avoid  many  uaelosa  comjvu'isonr-  t>y  jnmjing  diroctiy  to  a node  on 
t.tie  j-atii  wtiero  ttie  next  comj'arison  will  be  leaa  biaaed.  The  } roof  of 
L^'mnia  ■ indicates  that  a possible  strategy  is  to  jrunp  to  a node  of 
iioigiii  !i  where  ti  is  chosen  to  guarvuitee  that  a subtree  ol'  this 
height  contains  ai.  least  n/in  nodes.  f.ince  comj'Uting  this  tieight  during 
tiie  search  is  ex^iensive,  it  seems  prefei-able  to  jujii])  to  a fixed  dej  tli 
in  tiu'  tree,  such  as  log^  m , instead;  tliis  operation  is  extremely 
fast  using  an  array  stack  implementation,  .hunjdng  back  to  a depth 
near  Ig  m improves  tlie  average  case,  since  random  balanced  trees 
are  so  well  bal;mced,  but  it  makes  the  worst  case  greater  tlian 
0(m  log{/i/"0^  • 

Anotlnu’  ] ossible  sclieme  I'or  fast  mei'ging  is  i.o  use  tlie;  linear  list 
roj  resovitation  develo]ied  in  {'■)].  This  structure  iillows  a finger  into 
■ti\e  list  to  be  maintained  such  that  aJl  accesses  in  the  neighborliood 
I'l'  the  fingi'r  are  guaiaintced  to  be  efficient.  The  algorithms  of  [5] 
can  lie  extended  to  show  that  for  the  jau-j'Oses  of  merging,  tne  finger 
c.'ui  a.lso  be  moved  elTicicri-t.ly  w-ith  each  access,  giving  ;u)  0(m  log(n/ir.'') 

merging  algoritlun.  Tlris  list  re]  resentai.ion  is  vei-y  ci.)tn]'li cated,  however, 
.(I  idf  associated  mei'ging  jirocodure  is  not  "I'ast"  in  a ]'ractical  sen.-'e. 


Appendix.  A Sail  Implementation. 


The  following  is  a Sail  implementation  of  the  fast  balanced  tree  merging 

algorithm  . A complete  description  of  the  Sail  programming  language  is  given  in 

[8],  but  the  reader  who  is  familiar  with  AlgolW  or  Pascal  should  have  little 
difficulty  understanding  the  Sail  constructs  used  below.  The  following  points 
are  worth  noting: 

1)  A string  constant  preceding  a statement  Is  treated  as  a comment. 

2)  The  statement  'DONE  "blockName"'  causes  an  exit  from  the  loop  on  the  block 

named  "blockName". 

3)  RECORD_POINTER  parameters  are  passed  by  value. 

4)  The  logical  operations  a (and)  and  v (or)  are  executed  conditionally  when 

evaluating  an  IF  predicate,  as  In  LISP  but  unlike  A1go160.  For  exaipple, 

the  construct  'a  a p’  means  ’IF  a THEN  P ELSE  FALSE' . 


RECORD_CLASS  Node  (RECORO_POINTER(Nodo)  ILInk!,  rLInkI ; INTEGER  Bl ; INTEGER  Key!); 
COMMENT 

Format  of  tree  nodes:  pointers  ILink  and  rLInk  to  the  left  and  right  subtrees, 
an  integer  key,  and  a balance  factor  which  Is  the  height  of  the  right  subtree 
minus  the  height  of  the  left  subtree,  I.e., 

B[p]  = -1  ■ node  p is  unbalanced  to  the  left  (left  subtree  Is  taller), 

B[p]  = 0 a node  p is  balanced, 

B[p]  = +1  s node  p is  unbalanced  to  the  right. 

We  use  the  names  leftTaller,  balanced,  and  rIghtTaller  respectively  for  these 
values.  The  only  relation  between  them  which  Is  significant  to  the  program  Is 
that  leftTaller  » -rIghtTaller.; 


RECORD_CLASS  LIstHeader  (RECORD_POINTER(Node)  Root  I ; INTEGER  Height!,  Size!); 
COMMENT 

Format  of  list  header:  pointer  to  the  root  of  the  balanced  tree,  plus  an 
integer  giving  the  height  of  tree,  and  an  Integer  giving  the  number  of  nodes  In 
the  tree . ; 


COMMENT  Abbreviations  for  Node  and  LIstHeader  fields; 
DEFINE  ILink  = ( Node : ILink !)  ; 

DEFINE  rLink  = {Node:rLink! ) ; 

DEFINE  B = {Node:B! ); 

DEFINE  key  = (Node:key! ); 

DEFINE  Root  = {ListHeador:Rootl ); 

DEFINE  Height  * { LIstHeader :Height! ) ; 

DEFINE  Size  « (ListHoader:Sizol ); 


COMMENT  Manifest  constants; 
DEFINE  balanced  = (0); 

DEFINE  leftTaller  = (-1); 

DEFINE  rightTaller  = {*\); 
DEFINE  maxDepth  * {^4): 


PROCEDURE  FastMerge(RECORD_POINTER(L1stHead0r)  src,  dst); 

BEGIN  "FastMerge" 
i COMMENT 

[ The  FastMerge  procedure  performs  merging  of  sorted  lists  represented  as  balanced 

I binary  trees.  The  two  lists  are  passed  to  FastMerge  by  passing  the  two  pointers 

S src  and  dst  to  their  respective  list  header  nodes:  the  src  list  is  empty  on 

return  from  FastMerge,  and  the  dst  list  contains  the  result  of  merging  the  two 
1 ists . 

The  merging  algorithm  is  best  viewed  as  containing  two  relatively  independent 
processes,  the  dismantling  process  and  the  insertion  process.  (In  fact,  the 
most  natural  program  structure  for  the  FastMerge  procedure  would  use  coroutines 
for  these  processes.)  The  dismantling  process  operates  on  the  smaller  of  the 
two  lists,  which  contains  m nodes.  It  performs  a symmetric-order  traversal  of 
the  binary  tree  representing  this  list,  lopping  off  the  nodes  in  order  of 
increasing  key  size,  and  supplies  these  nodes  to  the  insertion  process  upon 
demand.  The  dismantling  process  runs  in  0(m)  steps. 

The  insertion  process  inserts  these  nodes  successively  into  their  proper 
position  in  the  larger  list,  which  contains  n nodes.  The  details  of  the 
insertion  algorithm  are  complicated,  but  the  Idea  is  simple.  The  first 
insertion  is  performed  using  the  normal  tree  search  and  insertion  algorithm. 
The  subsequent  insertions  are  not  independent  from  one  another,  since  the 
insertions  are  done  in  increasing  order.  So  the  algorithm  performs  these 
insertions  by  first  searching  upward  from  the  site  of  the  previous  Insertion  for 
the  root  of  a subtree  which  can  be  guaranteed  to  contain  the  node  being 
inserted.  Then  the  insertion  is  completed  by  the  usual  procedure.  The 
insertion  process  runs  in  0(m  log(n/m))  steps,  so  the  running  time  of  the  entire 
merging  algorithm  is  also  0(m  log(n/m)).: 

RFCORD_POINlER(Node)  ARRAY  d5tk[  1 :maxDepth ] ; INTEGER  dPtr; 

COMMENT 

Ihe  dStk  array  is  used  as  a stack,  containing  nodes  not  yet  output  during  the 
dismantling  process,  and  the  integer  dPtr  is  its  stack  pointer.  This 
structure  is  used  by  the  procedures  InitOismantle  and  GetNext  below.; 

PROCEDURE  InitD1smantle(RECORO  POINTER(ListHeader ) Head); 

BEGIN  "InitDismantle" 

COMMENT 

This  procedure  initializes  a 'stream'  which  produces  the  nodes  of  the  list 
headed  by  Head.  The  nodes  come  from  the  stream  in  increasing  order  of  Key 
value,  one  node  per  call  to  GetNext.  The  list  is  destroyed  In  this  process, 
so  InitOismantle  sets  all  fields  of  Head  to  a null  state.; 

IF  Size[Head]  = 6 THEN  dPtr  «-  8 

ELSE  dStk[dPtr  - 1 ] ♦-  Root[Head]; 

Root[Head]  - NULL_RECORD;  Size[Head]  - He1ght[Head]  - 0 
END  "InitDismantle": 

RECORO_POINTER(Nodo)  PROCEDURE  GetNext; 

BEGIN  "GetNext" 

COMMENT 

A call  to  this  procedure  returns  the  next  node  In  the  list  given  to 
InitDismantle,  with  ILInk  = rLInk  * NULL_RECORD  and  B * 0.  If  no  nodes  remain 
in  the  list,  the  value  NULL_RECORO  is  returned.; 

RECORD  POINTER(Node)  Nxt,  Nxtl; 

IF  dPtr  = 0 THEN  RE TURN( NULL_RECORD) ; 

Nxt  *•  dStk[dPtr];  dPtr  •-  dPtr-1; 

WHIIF  1Link[Nxt]  * NULL_RECORD  00  BEGIN 

Nxtl  - lLink[Nxt];  lLink[Nxt]  »•  NULL_RECORD; 
dPtr  - dPtr^l;  dStk[dPtr]  - Nxt; 

Nxt  «-  Nxtl 

i END; 


IF  rLink[Nxt3  ••  NULL_RECORD  THEN  BEGIN 
dPtr  «-  dPtr+l;  dStk[dPtr]  •-  rL1nk[Nxt]: 
rL1nk[Nxt]  - NULL.RECORD 
END; 

B[Nxt]  •-  balanced: 

RETURN(Nxt) 

END  "GetNext": 

RECORD_POINTER(Node)  ARRAY  pathStk  [ 1 :maxOepth];  INTEGER  pathPtr; 

INTEGER  ARRAY  succStk  f 1 rmaxDepth];  INTEGER  succPtr; 

"Invariant  ' PathProp’ : 

The  pathStk  contains  an  initial  segment  of  the  path  from  the  root  of  IgLst 
(as  modified  by  the  insertions  so  far  from  smLst)  to  the  position  which  some 
node  z (specified  when  this  invariant  is  applied  below)  from  smLst  has,  or 
will  have  after  an  insertion,  in  IgLst. 

The  succStk  contains  the  Indices  of  all  pathStk  entries  whose  ILinks  are 
also  in  pathStk,  i.e.  all  nodes  on  the  path  (excluding  the  last)  which  are 
greater  than  the  last  node  inserted." 

PROCEDURE  InitInsertion(RECORD_POINTER(ListHeader)  Head); 

BEGIN  "Initinsertion" 

COMMENT 

This  procedure  initializes  the  insertion  process  on  the  list  headed  by  Head, 
and  sets  all  of  the  fields  of  Head  to  a null  state.; 
pa^hPtr  •-  1;  pathStk[pathPtr ] Root[Head]; 
succP^f*  ^ 0* 

Root[Head]  ^ NULL_RECORO;  SizeCHead]  *•  He1ght[Head]  0 
END  "Initinsertion"; 

RECORD_POINTER(ListHeader)  smLst,  IgLst; 

RECORD_POINTER(Node)  p,  q,  r,  s,  t,  x; 

INTEGER  m,  n,  ht,  insCount,  sPtr,  a,  k; 


Initializations. 


d 


IF  S1ze[dst]  i Size[src]  THEN  BEGIN  IgLst  dstj  smLst  src  END 

ELSE  BEGIN  smLst  - dst;  IgLst  src  END; 

m ♦-  S1ze[  smLst]:  n ♦-  Size[lgLst];  ht  *■  H8lght[  IgLst]; 
InltDismantle(smLst);  In  It Insertion! IgLst); 


"The  insertion  process." 

FOR  insCount  - 1 STEP  1 UNTIL  m DO  BEGIN  "InsertLoop" 

X •-  GetNext; 
k •-  Key[x]: 

"Now  X is  the  next  node  from  smLst  to  be  inserted  into  IgLst,  with  lL1nk[x]= 
rLink[x]=NULL_RECORD,  B[x]=balanced,  and  k=Key[x].  PathProp  holds  with  z « 
the  previous  node  Inserted  into  IgLst;  on  the  first  Insertion  PathProp  does 
not  hold,  but  succStk  is  empty  so  UpLoop  below  Is  never  executed.  The 
purpose  of  UpLoop  is  to  make  PathProp  hold  with  z s x,  by  retracting  the 
path  as  little  as  possible  toward  the  root." 

WHILE  succPtr  k 0 DO  BEGIN  "UpLoop" 

IF  k < Key[pathStk[succStk[succPtr]]]  THEN  DONE  "UpLoop"; 
pathPtr  •-  succStkfsuccPtr];  succPtr  •-  succPtr-1 
END  "UpLoop": 
p pathStk[pathPtr]; 

"Now  X and  k are  as  before,  and  p is  on  top  of  pathStk.  Also,  PathProp 
holds  with  z = X.  The  purpose  of  SearchLoop  is  to  maintain  this  property 
while  extending  the  path  to  a leaf  of  IgLst,  and  then  to  add  x to  IgLst  and 
to  the  path." 

WHILE  TRUE  DO  BEGIN  "SearchLoop" 

IF  k < Key[p]  THEN  BEGIN  "Move  left" 

succPtr  *-  succPtr+l;  succStk[ succPtr ] •-  pathPtr; 
q lLink[p]; 

IF  q = NULL_RECORD  THEN  BEGIN  lL1nk[p]  «-  x;  DONE  "SearchLoop"  END 
END 

ELSE  BEGIN  "Move  right" 
q •-  rL1nk[p]; 

IF  q = NULL_RECORD  THEN  BEGIN  rLink[p]  ♦-  x;  DONE  "SearchLoop*  END 
END; 

P - q; 

pathPtr  •-  pathPtr+1;  path5tk[pathPtr]  «-  p 
END  "SearchLoop": 

pathPtr  «-  pathPtr+l;  pathStk[pathPtr ] x; 

"Now  PathProp  holds  with  z = x,  and  in  fact  x is  on  top  of  pathStk.  The 
purpose  of  AdJustLoop  is  to  adjust  all  of  the  balance  factors  on  the  path 
between  x and  s,  which  is  defined  to  be  the  first  unbalanced  node  on  the 
path  above  x (the  root  if  there  are  no  unbalanced  nodes  on  the  path.) 
AdjustLoop  does  not  alter  the  path." 

sPtr  pathPtr-1 ; 

WHILE  TRUE  DO  BEGIN  "AdjustLoop" 
s •-  pathStk[ sPtr ]: 

IF  BCs]  * balanced  v sPtrsl  THEN  DONE  "AdjustLoop"; 

B[s]  - (IF  k < Key[s]  THEN  leftTaller  ELSE  rightTal ler ) ; 
sPtr  •-  sPtr-1 
END  "AdjustLoop"; 

a - (IF  k < key[s]  THEN  leftTaller  ELSE  rightTaller); 


"The  purpose  of  the  following  Is  to  maintain  balance  In  the  subtree  rooted 
at  s.  In  two  cases  this  Is  trivial,  and  the  path  Is  not  affected.  In  the 
third  case  rebalancing  must  take  place,  which  Invalidates  a portion  of  the 
path;  this  portion  is  discarded,  and  the  root  of  the  rebalanced  subtree 
becomes  the  final  node  on  the  path.  In  any  case,  PathProp  will  still  hold 
with  2 = X." 

IF  B[s]  = balanced  THEN  BEGIN 
B[s]  *-  a;  ht  ♦-  ht+1 
END 

ELSE  IF  B[s]  = -a  THEN  BEGIN 
B[s]  ♦-  balanced 
END 

ELSE  BEGIN  "Rebalance" 
r ♦-  pathStk[sPtr+l]; 

IF  B[r]  = a THEN  BEGIN  "SIngleRotatlon" 
p - r; 

IF  a = rightTaller  THEN  BEGIN  rL1nk[s]  ♦-  ILInktr];  lL1nk[r]  - s END 
ELSE  BEGIN  lL1nk[s]  rL1nk[r];  rL1nk[r]  *•  s END; 
B[s]  B[r]  ♦-  balanced; 

END  "SIngleRotatlon" 

ELSE  BEGIN  "DoubleRotatlon" 

IF  a = rightTaller  THEN  BEGIN 

p •-  lLink[r];  lLink[r]  ► rLink[p];  rL1nk[p]  *-  r; 
rLink[s]  lL1nk[p];  lLink[p]  •-  s 
END 

ELSE  BEGIN 

p •-  rLink[r];  rLink[r]  «-  lL1nk[p];  lL1nk[p]  r; 
lL1nk[s]  •-  rL1nk[p];  rL1nk[p]  s 
END; 

B[s]  - (IF  B[p]  = +a  THEN  -a  ELSE  balanced); 

B[r]  (IF  B[p]  = -a  THEN  ^a  ELSE  balanced); 

B[p]  •-  balanced; 

END  "DoubleRotatlon"; 

IF  sPtr  > 1 THEN  BEGIN 
t «-  pathStk[sPtr-l]; 

IF  s = rLink[t]  THEN  rL1nk[t]  *-  p 
ELSE  lL1nk[t]  *-  p 

END; 

"The  tree  is  rebalanced;  delete  the  Invalidated  section  from  pathStk  and 
succStk . " 

pathPtr  •-  sPtr;  pathStk[ pathPtr ] *■  p; 

WHILE  succPtr>0  a succStk[ succPtr ]2:pathPtr  DO 
succPtr  *-  succPtr-1; 

END  "Rebalance"; 

"Now  PathProp  holds  with  z = x." 

END  "InsertLoop" ; 

Root[dst]  •-  pathStk[l];  He1ght[dst)  ht;  S1zo[dst]  •-  m ♦ n 


END  "FastMerge"; 
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Figure  1.  First  comparison  d\iring  a binatry  merge. 
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Figure  3. 
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Sorted  lists  rej;resented  as  balanced  binary  trees. 
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Figure  5.  Inserting  an  item  larger  than  x . (Subtrees  are 
labeled  with  the  range  of  key  vaJ-ues  which  may  be 
inserted. ) 


Rebalancing  after  iin  inrertion. 

(a)  Car.G  i..  Subtree  > contains  inserted  node  x . 

(b)  Case  P.  iiither  x r=  w and  and  > are  einj  ty 
or  subt.ree  contains  x . 


Algorithm  F 
Algorithm  I 

Algorithm  T 

Algorithm  L 


average  running  time  to  merge  list 
of  sizes  m and  n , with  m < n 

15.0  m lg(n/m)  + ll8.5ra  + U5.5 
11.2m  Ig  n + 88.5m  + 21 
55.9(iid-n)  + Urn  + 59*2 
10(m+n)  + 4m  + 52 


Figure  11.  Comparison  of  methods. 


